1.a program used for searching through websites on the Internet for documents containing a particular word, phrase, or subject
1.One of the most important parts of search engine is WebCrawler which can get the original information from network for the search engine.
搜索引擎一个重要部分是网络爬虫程序，依靠网络爬虫，搜索引擎可以获取用来检索的原材料信息。
2.Each search engine has its own automated program called a "web spider" or "web crawler" that crawls the web.
每个搜索引擎都有自己爬行网页的自动化程序，叫做“网络蜘蛛（webspider）”或“网络爬虫（webcrawler）”。
3.A MapReduce application or a web crawler application fits perfectly with this model.
典型的如MapReduce框架，或者一个webcrawler应用都很适合这个模型。
4.Analyze the pages which are crawled by WebCrawler, remove the control order and format on the page and remain the content only;
闭于网络爬虫爬取到的网页加以剖析，去除网页外的控造命令和格局，只保留外容；